Shannon information, LMC complexity and Rényi entropies: a straightforward approach
نویسندگان
چکیده
منابع مشابه
Shannon information, LMC complexity and Rényi entropies: a straightforward approach.
The LMC complexity, an indicator of complexity based on a probabilistic description, is revisited. A straightforward approach allows us to establish the time evolution of this indicator in a near-equilibrium situation and gives us a new insight for interpreting the LMC complexity for a general non equilibrium system. Its relationship with the Rényi entropies is also explained. One of the advant...
متن کاملSwiveled Rényi entropies
This paper introduces “swiveled Rényi entropies” as an alternative to the Rényi entropic quantities put forward in [Berta et al., Physical Review A 91, 022333 (2015)]. What distinguishes the swiveled Rényi entropies from the prior proposal of Berta et al. is that there is an extra degree of freedom: an optimization over unitary rotations with respect to particular fixed bases (swivels). A conse...
متن کاملShannon Information and Kolmogorov Complexity
We compare the elementary theories of Shannon information and Kolmogorov complexity, the extent to which they have a common purpose, and where they are fundamentally different. We discuss and relate the basic notions of both theories: Shannon entropy versus Kolmogorov complexity, the relation of both to universal coding, Shannon mutual information versus Kolmogorov (‘algorithmic’) mutual inform...
متن کاملMeasuring time-Frequency information content using the Rényi entropies
The generalized entropies of Rényi inspire new measures for estimating signal information and complexity in the time–frequency plane. When applied to a time–frequency representation (TFR) from Cohen’s class or the affine class, the Rényi entropies conform closely to the notion of complexity that we use when visually inspecting time–frequency images. These measures possess several additional int...
متن کاملRényi Extrapolation of Shannon Entropy
Relations between Shannon entropy and Rényi entropies of integer order are discussed. For any N–point discrete probability distribution for which the Rényi entropies of order two and three are known, we provide an lower and an upper bound for the Shannon entropy. The average of both bounds provide an explicit extrapolation for this quantity. These results imply relations between the von Neumann...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Biophysical Chemistry
سال: 2005
ISSN: 0301-4622
DOI: 10.1016/j.bpc.2004.12.035